UNCLASSIFIED 

ad  411582 


DEFENSE  DOCUMENTATION  CENTER 

FOR 

SCIENTIFIC  AND  TECHNICAL  INFORMATION 

CAMERON  STATION.  ALEXANDRIA.  VIRGINIA 


UNCLASSIFIED 


NOTICE:  When  government  or  other  drawings,  speci¬ 
fications  or  other  data  are  used  for  any  purpose 
other  than  in  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S. 
Government  thereby  incurs  no  responsibility,  nor  any 
obligation  whatsoever;  and  the  fact  that  the  Govern¬ 
ment  may  have  formulated,  furnished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regarded  by  implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  any  rights 
or  permission  to  manufacture,  use  or  sell  any 
patented  invention  that  may  in  any  way  be  related 
thereto. 


<M 

00 

lO 


ARP  A  ORDER  NO.  189-61 


MEMORANDUM 

RM-3624-ARPA 

MAY  1963 


r, 


g  o  EXISTENCE  AND  UNIQUENESS  THEOREMS 
^  IN  INVARIANT  IMBEDDING -II: 

^  co  CONVERGENCE  OF  A  NEW 

°  ^  DIFFERENCE  ALGORITHM 


Richard  Bellman  and  Kenneth  L.  Cooke 


PREPARED  FOR: 

ADVANCED  RESEARCH  PROJECTS  AGENCY 


O  O  C 

nniTs 

1  ’  Sj 

.>  I  !l 

it 

Eli  i 

.  vA  p 


Ik 


R-OflD 


(?OXjk&UlUoK 


SANTA  MONICA  •  CALIFORNIA 


1  * 


ARFA  ORDER  NO.  189-61 


MEMORANDUM 

RM-3624-ARPA 

MAY  1963 


EXISTENCE  AND  UNIQUENESS  THEOREMS 
IN  INVARIANT  IMBEDDING -II: 
CONVERGENCE  OF  A  NEW 
DIFFERENCE  ALGORITHM 

Richard  Bellman  and  Kenneth  L.  Cooke 


This  research  is  supported  by  the  Advanced  Research  Projects  Agency  under  Contract 
No.  SD-79.  Any  views  or  conclusions  contained  in  this  Memorandum  should  not  be 
interpreted  as  representing  the  official  opinion  or  policy  of  ARPA. 


1U 


I  TOO  WAIN  ST  •  SANTA  MONICA  •  CAilfOtNIA 


— iii— 


PREFACE 

Part  of  the  RAND  research  program  consists  of  basic 
supporting  studies  in  mathematics.  This  Memorandum  is  the  second 
in  a  series  dealing  with  a  number  of  rigorous  aspects  of  the  highly 
useful  mathematical  theory  known  as  invariant  imbedding.  In  this 
theory  invariance  principles  are  applied  to  handle  a  variety  of  conceptual 
and  computational  aspects  of  mathematical  physics. 

The  research  presented  here  was  sponsored  by  the  Advanced 
Research  Projects  Agency. 


SUMMARY 


The  theory  of  invariant  imbedding  leads  to  new  types  of 
difference  approximations  to  partial  differential  equations.  To 
illustrate  the  type  of  analysis  required  to  establish  the  convergence 
of  the  solution  of  one  to  the  solution  of  the  other,  we  consider  the 
difference  approximation  u(x  +  A,  y)  =  u(x,  y  +  u(x,  y)A)  ,  and 
the  limiting  equation  u^  3  uu^  . 
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EXISTENCE  AND  UNIQUENESS  THEOREMS  IN  INVARIANT 
IMBEDDING  -  II:  CONVERGENCE  OF  A  NEW 
DIFFERENCE  ALGORITHM 


1.  INTRODUCTION 

In  the  first  paper  of  this  series,  we  indicated  how  a  mathe¬ 
matical  model  of  a  "transport  process"  constructed  according  to  the 
theory  of  invariant  imbedding,  led  to  an  interesting  system  of  non¬ 
linear  ordinary  differential  equations  of  Riccati  type,  and  we  showed  . 
how  a  new  type  of  conservation  principle  could  be  used  to  establish 
existence  of  solutions. 

If  interactions  between  particles  are  admitted,  in  addition  to 
the  already  existing  interaction  between  particles  and  the  medium, 
then  invariant  imbedding  techniques  lead  to  partial  differential 
equations  of  hyperbolic  type.  The  stratification  used  in  the  derivation 
of  these  equations, following  imbedding  procedures, automatically 
produces  a  set  of  approximating  difference  equations  of  novel  form, 
quite  different  from  the  usual  equations  of  this  type;  see  Cl],  where 
other  references  may  be  found. 

Since  the  discussion  of  the  equations  arising  from  invariant 
imbedding  is  rather  complex,  we  shall  illustrate  the  method  first 
with  an  analogous  treatment  of  the  equation 


u  +  uu  *  0, 
x  y  ’ 

u(0,  y)  »  g(y), 


x  >  0, 


(1.  l) 


<  y  <-, 
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an  equation  of  some  interest  in  itself.  We  shall  consider  an 
approximating  difference  equation 

(1.2)  u(y,  x  +  A)  =  u(y  —  u(y,  x)  & ,  x)  , 

x  =  0,  A ,  2  A ,  . . . ,  —  ®  <  y  <  • ,  an  equation  which  we  know  yields 
excellent  numerical  results;  [2],  [3].  For  x  ^  nA,  u(y,  x)  is 
defined  by  linear  interpolation. 

Equation  (1.  1)  is  an  exceedingly  useful  nonlinear  partial 
differential  equation,  since  it  possesses  an  explicit  solution  (in 
implicit  form,  u  =  g(x  +  uy)  that  exhibits  a  shock  phenomenon. 
Hence,  it  is  a  very  handy  test  of  proposed  numerical  procedures. 

Looking  at  Eqs.  (1.1)  and  (1.  2  \  there  are  several  questions 
we  can  ask: 

(1.3)  a.  As  A  ”•  0,  does  the  solution  of  (1.2)  approach 

the  solution  of  (1.  1),  assuming  that  we  have 
already  established  the  existence  of  a  unique 
solution  of  (1.  1)  ? 

b.  Can  we  use  (1.2)  to  establish  the  existence  of 
a  solution  of  (1. 1)  ? 

c.  Let  A  -*  0  through  a  sequence  (a/2n)  and  call 

the  function  obtained  from  (1.2),  with  A  *  a/2n, 

u  (x,  y).  Does  the  sequence  {u  (x,  y)  }  converge, 
n  n 

independently  of  the  existence  of  solutions  of  (1. 1)  ? 
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These  questions  are  of  computational  significance  as  well 
as  analytic  interest.  We  shall  discuss  (a)  and  (c)  here,  and  reserve 
a  discussion  of  (b)  for  a  later  paper  devoted  to  the  more  complex 
equations  associated  with  transport  processes. 

In  passing,  let  us  refer  the  reader  to  f  8  ]  where  the  problem 
of  obtaining  higher  order  approximations  of  the  general  form  of  (1.2) 
is  briefly  discussed. 

2.  PRELIMINARIES 

Let  us  introduce  the  following  notation: 

(2.  1)  un(y)  =  u  (n  A,  y),  (y)  =  A-  u(nA,  y) , 

and  the  norms 

(2.2)  un  =  !  I  un  (y)  I  I  *  max  I  (y)  I  , 

Un  =  hu^(y)||  =  myx  > 

c  j  =  max  lg(y)l • 

We  assume  that  g(y)  is  continuous  for  all  y,  and  that  <  ®. 

The  recurrence  relation  of  (1.  2)  assumes  the  form 

(2.  3)  un+l(y)  3  Un(y  “  un(y) L)  ’  n  =  °.  2 . 

u  (y)  =  g(y).  This  is  a  difference  equation  which  is  more  closely 
related  to  the  functional  equation  studied  by  Myskis  f4  ]  than  are  the 
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conventional  differential  equations  whose  study  was  initiated  by 
Courant,  Friedrichs  and  Lewy;  see  [5]  for  further  references. 
Differentiating  with  respect  to  y,  we  have 

(2.4)  un+l^y)  =  Un^y  "  f1  "  • 

Upon  taking  absolute  values  we  are  led  to  the  following  inequality 
between  norms: 


(2.  5)  u*  <  u'  (1  +  iu' ) , 

n+ 1  —  n  n 

a  Riccati  difference  inequality. 

For  our  further  purposes,  we  require  the  following  simple  result. 

Lemma.  Let  {u^J  be  a  sequence  of  nonnegative 
numbers  satisfying  the  relation 


(2.  6)  ujl<cA+u(l  +  2cA+cAu),  n  *  0,  1, 

n+1  -  n  n  9  9  9 


Then  if  A  is  sufficiently  small,  viz. , 


(2.7) 


cn  A  < 


1  +  u0  ’ 


it  follows  that 


(2.8) 


u  < 
n  — 


1  +  u„ 


—  cn  A 


-1 


-  1 
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Proof.  Let  {v  }  be  defined  by  the  equation 
■  n 


(2.9)  vn+1  =  cA+ vn(l  +  2cA  +  cAvn)  ,  vQ  *  uQ  . 


It  is  clear  that  vr+1  >  vr  and  vr  >  for  n  *  0,  1,  2,  ...  . 
Then 


(2.  10) 


v  ,  —  v 
n+1  n 


(1  +  vn>  (1  *  vntl) 


c  A 


tl  +  v„’ 

<1  +  '-n*>) 


<  c  A . 


Hence 


(2.  ID 


"E1  Villi  .  _i_ 

i*t)  (1  +  v{)  (1  +  vl+l)  1  +  VQ 


i-nr<cnl- 

n 


a  result  which  implies  (2.  8). 

Returning  to  (2.  5),  we  see  that  (ur  }  satisfies  (2.  6),  with 
c  ■  1,  whence 

(2. 12)  u^  < 

provided  that  n  A  <  1  /(I  +  u^) . 

Keeping  the  x-interval  small  enough,  n  A  <  a  <  1 ,  we  obtain 

a  bound  on  u'  which  is  independent  of  n  and  A. 
n 

3.  PROOF  OF  CONVERGENCE  TO  KNOWN  SOLUTION 

Let  us  now  turn  to  the  discussion  of  the  convergence  of  the 
solution  of  (1.  2)  under  the  hypothesis  that  we  have  already  established 
the  existence  of  a  solution  in  an  initial  x— interval  0  x  ^  a,  a  matter 


1  +  u. 


—  n  A 


-1 


-  1, 


—6~ 


easily  accomplished  in  this  case  and  indeed  explicitly  by  means  of 
the  implicit  relation  mentioned  in  Sec.  1. 

Let  v(x,  t)  represent  this  solution  which  possesses 
continuous  derivatives  in  the  region  0<x<a,  — »  <  y  <  »,  if  a 
is  small.  Then  we  have  the  equation 

(3.1)  v  (x  +  A,  y)  3  v(x,  y  -  Av(x,  y))  +  o(  A) , 
uniformly  in  this  region.  Set 

(3.2)  un(y)  =  u  (n  A,  y),  vR(y)  s  v(nA,y). 

Then  (3.  1)  and  (2.  3)  yield  the  relation 

(3.3)  un+  j  (y)  ~  vn+ 1  fa)  ’  un(y  -  Aun(y))  -  vn(y- A  vn(y))  +  o(  A) 

=  u  (y  -  Avn  (y))  -  vn(y  -  A  vn(y)) 

-  u  (y  —  Avn  (y))  +  UR(y  -  A  un(y))  +  o  (  A) . 

Introduce  the  sequence  of  constants  {r^},  where 

(3.  4)  r  *  max  |u  (y)  —  v  (y)|  . 

n  y  n  J  tlj 

Then  (3.  3)  yields 

I  un+  i(y)—  vn+  i^y^  I  <  lun(y-  Avn(y))-vn(y  -  Avn(y))  | 

+  I  unty  ~  Avn(y»-un(y  -  Aun(y))  | 

+  o(A), 


(3.  5) 


-7- 


or 


(3.6) 


r  ,<r  +  Aru'+«A, 
n+1  -  n  n  n 


<rn(l  +  ClA)  +  «A 


(where  c  -0  as  A  -*0),  because  of  the  uniform  bound  on  u^  estab¬ 
lished  in  Sec.  2  above.  It  is  easy  to  show  inductively  that  this  implies 

c.nA  c  1  a 

(3.7)  r  <  —  (e  -  1)  <  -  (e  -  1), 

n  -  c1  -  c 

since  nA  <  a.  It  follows  that  r  -  0  as  A  -*  0,  and  thus  that 
-  n  7 


(3.8)  lim  (u(  x,  y)  -  v(  x,  y))  =  0,  0<x<a,  0  <  y  <  a* 

A  -  0 

Hence,  if  a  solution  of  the  presented  type  exists,  the  sequence 
defined  by  (2.  3)  converges  to  it.  Furthermore,  the  foregoing 
establishes  the  uniqueness  of  such  a  solution. 


4.  PROOF  OF  CONVERGENCE  OF  DISCRETE  SEQUENCE 

Let  us  now  turn  to  a  demonstration  of  the  convergence  of 
the  sequence  (un(y)  }  *n  the  case  where  we  do  not  presuppose  the 
existence  of  a  solution  of  the  partial  differential  equation.  Let 
a  >  0,  and  choose  successively  A  s  a,  a/2,  a/4,  ...  .  Let 
u(x,  y)  be  an  approximating  function  determined  by  a  particular  A 
in  this  sequence  and  let  u(x,  y)  be  the  corresponding  function  for 
A/2. 
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As  before,  we  let 


(4.1)  un(y)  3  u(n4,  y),  ii(y)  =  il(nA,  y). 


Now  let  us  compare  these  two  functions.  We  have 


(4.2) 


un+l(y)  ’  4 


and, using  (2.  3)  twice, 


(4.3) 


V,W  ■ 


)  A,  y  -  |  u((n  + 


ju,y>] 


where 


(4.4)  y'  =  y -4  u  ((n  +  ^  )  A,  y) 


Since  y1  sy  +  0(A),  we  have 


(4.5)  un(y')  *  un(y)  +  °(&), 


using  the  uniform  boundedness  of  u  and  u^  ,  as  shown  above. 
Furthermore, 


(4.6)  u((n  +  ^)A,  y)  =  un(y-|  fin(y) )  *  un(y)  +  0(A) 


Hence 


(4.7)  y'  =  y  Qn(y)  +  °( A2), 
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where  the  0— term  is  uniform  in  x,  y,  and  A. 

Equations  (4.7)  and  (4.2)  enable  us  to  compare  the  functions 
u  and  fl  at  x  =  0,  A,  2  A,  .  .  .  .  We  shall  prove  that  there  exist 
positive  numbers  a  and  k  such  that 

n 

(4.  8)  max  |  u  (y)  —  fl  (y)  |  <  kn  A  , 

y  n  n 

for  nA  =  0,  A,  .  ..  ,  a.  Proceeding  inductively,  suppose  that  it 
holds  for  n.  Using  (4.  2)  and  (4.  7),  we  have 


(4.9)  I  un+  j(y)  -  Qn+  j(y)  |  <  I  un(y  -  Aun(y))  -  un(y  -  A  un(y))  I 


+  I  un(y  -  Aun(y))  -  un(y  -  A  (l^y))  I 


+  Cj  A 


2  2 
<  kn  A  +  c  ^  A 


+  lun(y  -  Aun(y))  -  un(y  -  A  fln(y))  I 


2  2  i 

<  kn  A  +  c  A  +c„A|u(y)  —  u(y)| 
a  &  n  n 


2  2  2 
<  knA  +  Cj  A  +c^A(knA  ). 


Since  n  A  <  a  ,  we  can  write  (4.  9)  as 


2  2 

(4.10)  |un+1(y)  -  un+1(y)|  <  knA  +  CjA  +c2A(kaA) 


Hence  if  k  and  a  are  chosen  so  that 


-10- 


(4.11)  c  j  +  c^ka  <  k  , 

which  means  c^a  <1,  k  >  ,  the  induction  is  complete. 

Since  u(x,  y)  and  u(x,  y)  have  been  defined  by  linear 
interpolation  for  x  not  a  lattice  point,  we  have 


(4.  12)  may  |u  (x,  y)  -  u  (x,  y)  |  <  c„  A,  0<x<a. 

y  ~  6  ~  ~ 

If  we  let  u^(x,  y)  denote  the  approximating  function  corresponding 

to  A  =  a/2r,  r  =  1,  2,  ...,  we  obtain  from  (4.  12)  the  estimate 

n  .  i  n  C3a  c~a 

(4.13)  L  lu^tx,  y)-ur(x,  y)|  L  -yyy  < 


r  =n  2 


from  which  we  deduce  that 


(4.  14)  lim  u  (x,y)  =  u(x,  y) 

n  -• 00  n 

exists  uniformly  for  0  <  x  <  a,  — 00  <  y  <  ®  . 

5.  GENERALIZED  SOLUTIONS 

In  the  case  of  the  general  equations  of  invariant  imbedding 
T6  ],  we  are  interested  in  establishing  the  limiting  behavior  of 
equations  obtained  from  an  infinitesimal  stratification  of  a  medium. 

The  procedure  we  have  used  above  enables  us  to  define  a  "generalized 
solution"  in  a  new  sense,  an  idea  already  put  forth  in  T?],  in 
connection  with  the  application  of  dynamic  programming  to  the 


calculus  of  variations. 
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In  subsequent  papers  we  shall  discuss  the  utility  of  these 
new  difference  schemes  in  connection  with  establishing  the  existence 
of  a  solution  of  the  corresponding  hyperbolic  partial  differential 
equations  of  invariant  imbedding  from  first  principles. 


-13- 


REFERENCES 


1.  Noh,  W.  F.  ,  and  M.  H.  Protter, “Difference  Methods  and  the 

Equations  of  Hydrodynamics J.  Math,  and  Mech.  t  Vol.  12, 
1963,  pp.  149-192. 

2.  Bellman,  R.  E. ,  I.  Cherry,  and  G.  M.  Wing,  “A  Note  on  the 

Numerical  Integration  of  a  Class  of  Nonlinear  Hyperbolic 
Equations, “Q.  Appl.  Math.,  Vol.  16,  1958,  pp.  181-183. 

3.  Bellman,  R.  E.  ,  R.  Kalaba,  and  B.  Kotkin,  ’bn  a  New  Approach 

to  the  Computational  Solution  of  Partial  Differential  Equations,  “ 
Proc.  Nat.  Acad.  Sci.  USA,  Vol.  48,  1962,  pp.  1325-1327., 

4.  Myskis,  A.  D.  ,  “Linear  Differential  Equations  with  a  Delayed 

Argument,  “  Gos  Izd.  Tekhniko— Teoret.  Lit. ,  Moscow,  1951. 

5.  Bellman,  R.  E.  and  K.  L.  Cooke,  Differential-Difference 

Equations,  Academic  Press,  New  York,  1963. 

6.  Bellman,  R.  E.  ,  R.  Kalaba  and  G.  M.  Wing,  “invariant 

Imbedding  and  Mathematical  Physics  —  I:  Particle  Processes,  “ 
J.  Math.  Phys.,  Vol.  1,  1960,  pp.  280-308. 

7.  Bellman,  R.  E.  ,  "Functional  Equations  in  the  Theory  of  Dynamic 

Programming  -  VI:  A  Direct  Convergence  Proof,  "  Ann.  Math. , 
Vol.  65,  1957,  pp.  215-223. 

8.  Bellman,  R.  ,  "Some  Questions  Concerning  Difference  Approxi¬ 

mations  to  Partial  Differential  Equations,  "  Boll.  d'Unione 
Matematico,  Vol.  17,  1962,  pp.  188-190. 


